Add spans in compressor for perfetto#7607
Conversation
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
38a5f1b to
d4c70e0
Compare
Polar Signals Profiling ResultsLatest Run
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 1.007x ➖ datafusion / vortex-file-compressed (1.007x ➖, 0↑ 1↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.017x ➖, 0↑ 0↓)
datafusion / parquet (1.017x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.017x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.975x ➖, 1↑ 0↓)
duckdb / parquet (1.045x ➖, 0↑ 2↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.999x ➖, 0↑ 0↓)
datafusion / parquet (1.016x ➖, 1↑ 1↓)
datafusion / arrow (1.003x ➖, 0↑ 2↓)
duckdb / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
duckdb / parquet (0.989x ➖, 2↑ 0↓)
duckdb / duckdb (0.989x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMENo file size changes detected. |
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.973x ➖, 2↑ 0↓)
datafusion / vortex-compact (0.966x ➖, 4↑ 0↓)
datafusion / parquet (0.964x ➖, 8↑ 0↓)
duckdb / vortex-file-compressed (0.962x ➖, 4↑ 0↓)
duckdb / vortex-compact (0.963x ➖, 8↑ 0↓)
duckdb / parquet (0.974x ➖, 3↑ 1↓)
duckdb / duckdb (0.974x ➖, 6↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.020x ➖, 0↑ 1↓)
datafusion / vortex-compact (1.005x ➖, 0↑ 0↓)
datafusion / parquet (0.960x ➖, 1↑ 0↓)
duckdb / vortex-file-compressed (1.028x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.034x ➖, 0↑ 1↓)
duckdb / parquet (1.006x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (0.987x ➖, 1↑ 0↓)
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
duckdb / parquet (0.984x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.974x ➖, 1↑ 0↓)
datafusion / vortex-compact (0.997x ➖, 0↑ 0↓)
datafusion / parquet (1.000x ➖, 0↑ 0↓)
datafusion / arrow (1.000x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
duckdb / parquet (0.996x ➖, 0↑ 0↓)
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.992x ➖, 0↑ 1↓)
datafusion / parquet (0.973x ➖, 1↑ 0↓)
duckdb / vortex-file-compressed (0.989x ➖, 1↑ 2↓)
duckdb / parquet (0.988x ➖, 1↑ 1↓)
duckdb / duckdb (0.998x ➖, 5↑ 6↓)
Full attributed analysis
|
File Sizes: Clickbench on NVMEFile Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
|
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.001x ➖, 1↑ 0↓)
datafusion / vortex-compact (1.095x ➖, 0↑ 4↓)
datafusion / parquet (1.026x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.051x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.046x ➖, 0↑ 0↓)
duckdb / parquet (1.049x ➖, 0↑ 1↓)
Full attributed analysis
|
Benchmarks: Random AccessVortex (geomean): 1.100x ➖ unknown / unknown (1.079x ➖, 1↑ 13↓)
|
Benchmarks: CompressionVortex (geomean): 1.006x ➖ unknown / unknown (1.001x ➖, 0↑ 3↓)
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.997x ➖, 1↑ 0↓)
datafusion / vortex-compact (0.986x ➖, 0↑ 1↓)
datafusion / parquet (0.943x ➖, 2↑ 0↓)
duckdb / vortex-file-compressed (0.977x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.948x ➖, 0↑ 0↓)
duckdb / parquet (1.001x ➖, 0↑ 0↓)
Full attributed analysis
|
Summary
Tracking issue: #7216
Adds some more interesting spans to the compressor. This lets us use perfetto to visualize where time is being spent more easily. Also removes some noisy logs that don't tell us that much.
Also removes some tests that are probably useless.
Definitely gives us some interesting insights on things!
Testing
N/A